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Robust Consensus Tracking of Heterogeneous Multi-Agent 
Systems under Switching Topologies 

Yutao Tang * 


Abstract In this paper, we consider a robust consensus tracking problem of heterogeneous multi-agent 
systems with time-varying interconnection topologies. Based on common Lyapunov function and internal 
model techniques, both state and output feedback control laws are derived to solve this problem. The 
proposed design is robust by admitting some parameter uncertainties in the multi-agent system. 
Keywords Robust consensus tracking, multi-agent system, internal model, switching topology. 


1 Introduction 


The past decade has witnessed a rapid development in the field of multi-agent system and many fruitful 
results have been obtained. As one important topic, the consensus problem is actively studied due 
to its numerous applications such as cooperative control of unmanned aerial vehicles, communication 
among sensor networks, and formation of mobile robots (see [l[0] and the references therein). Consensus 
means that a group of agents reaches an agreement on a physical quantity of interest by interacting with 
their local neighbors. Roughly speaking, existing consensus problems can be categorized into two types: 
consensus without a leader (i.e., leaderless consensus or synchronization) and consensus with a leader. 
The case of consensus with a leader is also called leader-following consensus or consensus tracking. 

The consensus tracking problem of multi-agent systems has been studied for many years. This problem 
with agents in the form of single-integrators or double-integrators has been widely investigated (0-Q|). 
In 0, the authors proposed a distributed observer-based control law using local information to track 
an integrator-type leader. Later, this work has been extended to multi-agent systems with a general 
linear dynamics (@, 0|) under switching topologies. Other extensions including consensus tracking with 
an unknown-input driven leader or a designed abstracted system have been studied in Q, 0, [Tf 

Recently, a general framework based on output regulation theory (|10|) has been developed for multi¬ 
agent consensus (0, Q|)> where distributed control could achieve both asymptotic tracking and dis¬ 
turbance rejection. For example, as an extension to the results in Q|, a cooperative output regulation 
problem of heterogeneous multi-agent systems was formulated in [3] and solved by devising a distributed 
observer, where the exosystem can be viewed as the leader in the leader-following formulation. However, 
these results were obtained with a fixed topology. A similar problem but under a class of switching topolo¬ 
gies was considered in ■ Both dynamic state feedback and measurement output feedback control laws 
were proposed by using the full information of the exosystem which may be undesirable sometimes. With¬ 
out requiring exactly known system matrices, many robust results were further obtained which can handle 
parameter uncertainties in the multi-agent system. For example, the authors in 11] proposed a robust 
control law based on internal model design with a no-loop graph which admits parameter uncertainties 
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in the system matrices. Later, the no-loop graph assumption was removed in fl3 |. These results were 
mainly achieved with fixed topology. Very few results were obtained on robust output regulation with 
switching topologies, except that a control design was investigated in fl~t3 | based on canonical internal 
models to deal with small parameter uncertainties. However, this method was only applicable to the 
square follower system and led to an output feedback control law. 

Our main motivation is to investigate the robust consensus tracking problem of heterogeneous multi¬ 
agent systems under switching topologies, which may have parameter uncertainties in their system ma¬ 
trices. To facilitate the control goal, a distributed observer regarding switching topologies is at first 
constructed for each agent, and thus the robust consensus tracking problem can be solved by incorporat¬ 
ing an internal model in the controller for each agent. Our main contributions are at least two-fold: 


We extend the conventional leader-following consensus (e.g., [2, (5[) to general linear multi-agent 
systems with parameter uncertainties. When there are no such uncertainties, these results are 
consistent with existing consensus and distributed output regulation results, e.g., B Q- 


• We consider the distributed/cooperative robust output regulation problem under switching topolo¬ 
gies, and robust control laws are proposed for heterogeneous multi-agent systems, while many 
existing regulation results were derived for only homogeneous multi-agent systems ( 12J) or for 
fixed graph cases ([ll,Q]). 

Moreover, both output and state feedback control laws are proposed to solve the the robust output 
regulation problem considered in [Tfit . and these control laws are also applicable to the follower system 
whose inputs have different dimensions with its outputs. 

The rest of this paper is organized as follows. In Section 2, the problem formulation is given. Main 
results are presented in Section 3, where two types of robust consensus control laws are proposed. Finally, 
simulations and our concluding remarks are presented at the end. 

Notations: Let R" be the n-dimensional Euclidean space, R nxm be the set ofnxra real matrices, 0„ xm 
represents an n x m zero matrix. 1„ represents a column vector of n entries equal to 1. diag{6i,..., b n } 
denotes an n x n diagonal matrix with diagonal elements 6, (z = 1,..., n); col(ai,..., a n ) = [af,..., af ] T 
for any column vectors ai (z = 1,..., n), vec(A) = col(Ai,..., X n ) with A'; as the z-th column of a n- 
column matrix X. A weighted directed graph (or weighted digraph) Q = (A f,£,A) is defined as follows, 
where Af = (1,.. .,n) is the set of nodes, £ C Af x Af is the set of edges, and A G R” x " is a weighted 
adjacency matrix ( 19(). (z, j) G £ denotes an edge leaving from node i and entering node j. The weighted 
adjacency matrix of this digraph Q is described by A = [a»j]i,j=i,...,n, where an = 0 and a^- > 0 (a,j > 0 
if and only if there is an edge from agent j to agent i). A path in graph Q is an alternating sequence 
ziei* 2 e 2 - • -efc-iZfc of nodes ii and edges e m = (i m , i m +i) G £ for l = 1, 2,..., k. If there exists a path from 
node i to node j then node z is said to be reachable from node j. The neighbor set of agent z is defined 
as Afi = {j : (j, z) G £} for i = 1,..., n. A graph is said to be undirected if a.^ = aji (i,j = 1,..., n). The 
weighted Laplacian L = [Uj] G M. nxn of graph Q is defined as In = a,ij and Uj = —aij(j / z). 


2 Problem Formulation 


Consider a group of N + 1 agents, and N of them are followers described by 

Xi = (Ai + A Ai)xi + (Bi + 

Vi = ( Ci + A Ci)xi + (A + ADi)m, i = 1,... ,2V 


(1) 
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where Xi G Ui G R Pi , yi G K 9 are the state, input, and output of agent i, respectively. Ai G 
K niXni ,B i G M. niXPi ,Ci G R qxni ,Di G K 9XPi represent the nominal part of the plant, while AAj, AB i: ACi, AA 
represent the uncertain part. Without loss of generality, assume the triple (C*, Ai, Bi ) is controllable 
and observable. 


Let Wi = vec 


AAi 

AC, 


A B t 
A A 


be the uncertain vector for agent i and denote A,; ( w ) 


Ai+AAi, Bi{w) — 


Bi + A Bi, Ci(w ) = Ci + A Ci,Di(w) = A + Ad„w = col(wi,.. .,w N ). 


The leader(node 0) is as 


v = Sv, yo = —Fv 


( 2 ) 


where S G R mxm , F G M 9Xm , and (F, S) is observable. 

Associated with this multi-agent system, a dynamic digraph Q can be defined with the nodes M = 
{0,1, ...,./V} to describe the communication topology, which may be switching. If the control can get 
access to the information of agent j at time instant t, there is an arc ( j,i ) in the graph Q, i.e., a.y > 0. 
Also note that aoi = 0 for i = 1, ...,7V since the leader won’t receive any information from the followers. 
Denote the induced subgraph associated with all followers as Q. The associated Laplacian of this digraph 
can be partitioned as 


0 

OixJV 

L 

H 


where L G M Arxl and H G M. NxN . 

To achieve the coordination of the multi-agent system, node 0 in Q should be globally reachable, 
and therefore at least one agent in each component of Q is connected to the leader. Otherwise, the 
coordination between the agents and the leader cannot be achieved. We say a communication graph is 
connected if the leader (node 0) is reachable from any other node of Q and the induced subgraph Q is 
undirected. By Lemma 3 in 0|, F[ is positive definite if the communication graph is connected. Denote 
its eigenvalues as Ai > A 2 > • • • > Ajv > 0. 

In multi-agent systems, the connectivity graph Q may be time-varying. To describe the variable 
interconnection topology, we denote all possible communication graphs as Q \,... ,Q K , V = {1,..., «}, and 
define a switching signal a : [0, 00 ) —»■ V, which is piece-wise constant defined on an infinite sequence 
of nonempty, bounded, and continuous time-intervals. Assume tj+i — tj > tq, Vi, where U is the i-th 
switching instant and to = 0. Here To is often called the dwell-time. Therefore, J\fi and the connection 
weight aij ( i,j = 0,1,..., N) are time-varying. Moreover, the Laplacian A(t) and the matrix Ar(t) 
associated with the switching interconnection graph Q a (t) are also time-varying (switched at U, i = 
0,1,...), though they are time-invariant in each interval [A U+i). 

The following assumption on the communication graph is made. 


Assumption 1 The graph is switching among a group of connected graphs with the leader as its root. 


The robust consensus tracking problem of this heterogeneous multi-agent system can be formulated as 
follows. Given the multi-agent system composed of the follower (ED, the leader m and its corresponding 
communication graph G a (t)> find a robust control law such that , there exists an open neighborhood W of 
w = 0, for any initial condition Xi(0) G K. rai , u(0) G K. m , w G W, the consensus tracking goal is achieved, 
i.e., ei = yi — yo —■> 0 for i = 1,. .., N as t —t 00 . 

Note that, the system of agents considered are all with general linear models and can be seen as 
extensions to the well-studied consensus tracking problem in existing results for integrator-type agents 

( 0 , 0 , 13 ). 


3 








Another assumption is needed to solve this robust consensus tracking problem. 


Assumption 2 Let X be any eigenvalue of S, it holds 

rank 


At — XI Bi 
a Di 


= m + q. 


( 3 ) 


Remark 1 This condition is often called the transmission zero condition (\Z(\1 ) and is a key ingredient 
to solve the robust output regulation problem in centralized cases. 

Remark 2 When all agents have the same nominal system matrices, i.e., Aj = A, Bi = B, Ci = C, Di = 
D, a similar result have obtained in H/ under a fixed topology. Note that the interconnection in our 
formulation allows switching topologies, which renders this problem more challenging. 


3 Main Results 

In this section, we give a robust design scheme based on internal model techniques. 

Unlike in decentralized cases ( 17|), we do not assume the availability of yo to all agents in our problem. 
An agent can get access to yo unless there is an arc from the leader to this agent. Since not all followers 
can directly get access to the leader’s information, we first build a distributed observer for each agent as 
follows. 


Vi = Svi - L 0 Fi] vi (4) 

where r\ V i = Ylf=o a ij(t)(Vi ~ Vj)> Vo = v and Lq is a gain matrix to be selected. 

To establish the performance of this distributed observer, the following lemma will be used. 

Lemma 1 Let P be a positive definite symmetric solution of the Lyapunov inequality 

PS + S T P - 2 F t F < 0. (5) 

Take Lq = yP~ 1 F T , then under Assumption QJ there exist positive constants y* and c, such that, when 
y > y*, it holds 

(S - X p L 0 F) T P + P{S - X\LoF) < -cP (6) 

where X? > 0 for i = 1,..., N are the eigenvalues of H p (p £ V). 

Proof: Note that there are only finite graphs satisfying Assumption [lj the minimum eigenvalue of H p 
for all p is well-defined and denoted as A > 0. Taking y* = maxji, 1}, we obtain 

(S-XPLoF) T P + P(S-X p t L 0 F) 

= S T P + PS~ 2yX p F T F 
= S T P + PS- 2 F t F - 2(yX p - 1 )F T F 
< S T P + PS~ 2F t F 

Since S T P + PS — 2 F T F is negative definite, there exists a sufficiently small constant c satisfying the 
inequality ©. I 

The next lemma shows the convergence of fl]) and thus guarantees that each agent can asymptotically 
get the state information of the leader. 
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Lemma 2 Under Assumption [7J there exists a constant matrix Lq, such that, r)i will exponentially con¬ 
verge to v as t goes to infinity, in the sense of \\rji — u|| < coe~ Xot for some constants cq and Ao- 

Proof: Let rj = col(? 7 i, ..., Vn) and fj = rj — 1 ® v. After some mathematical manipulations, it follows 

fj = (I N ® S - H a{t ) ® L 0 F)fj 

Note that H a ^ is constant and positive definite under Assumption |T] during each interval. We first 
consider this problem in an interval [ti,ti+i). Assume a(t ) = p for t £ [U,ti+ 1 ), there exists a unitary 
matrix U p such that A p = U p H p U p = diag{Af,..., A^}. Let fj = (U p <g) In)v, then, 

V = (In ® S - A p <g) L 0 F)fj 

that is, rji = (S—X^LqF)^ for i = 1,..., N. By selecting L 0 as that in Lemma[l]and letting V m = fjjPrji, 
we can derive V Vi < —cV m . Recalling the dwell-time assumption, this inequality holds for all t. Let 
V v (t ) = V Vi (f), it follows V v < —cV v . Note that fj T fj = rj T fj, then 

|| Vi - I'll 2 < V T V < Amin(^) _1 K)(i) < X m in(P)~ 1 V v (0)e~ Ct . 

The conclusion follows readily. 1 


Remark 3 It has been proved that, a sufficient and necessary condition for the linear matrix inequality 
(ED is the detectability of ( F, S) (flal). Hence, the observability of the leader system is sufficient to build 
an exponentially convergent distributed observer of the form ED under Assumption 0] 


Remark 4 A similar result has been obtained in H/ but under a fixed topology. Extensions under 
switching topologies were also obtained in I? .51 / but assuming S has no eigenvalues with positive real 
parts. Lemma\^ allows that S can have eigenvalues with positive real parts and hence includes unbounded 
references for this multi-agent system under switching topologies. Moreover, while full-information of the 
leader was used in r lA. 131. i.e., F = I q , we only needs the referenced output yo here and avoid the cases 


when the availability of the leader’s full-information is not desirable. 


Next, we first consider a dynamic state feedback control to achieve the robust consensus tracking goal 
and then propose an output feedback design. 

Let a(s) = s Pm + a\s Pm ~ 1 + • • • + a Pm -\s + a Pm be the minimal polynomial of S, G\ = I q (& (3, and 
G 2 = I q < 8 > 7 with 


P = 


0 

Ipm — 1 

~ a Pm 

~ a Pm~l ■ ■ • 1 


7 = col( 0 , 0 ,..., 0 , 1 ). 


Pm- 1 


Evidently, the pair (Gi,G 2 ) is controllable. It is the so-called g-copy of S (|20|). By incorporating its 
g-copy of the leader, we propose a state feedback control law of the form 


Ui — A E2i.fi 

fi = Gift + G 2 (yi + Frji) 

Vi = Srji- L 0 Fr] vi 


where Gi, G 2 are as defined and Ku, K-h to be determined later. 

By a similar proof of Lemma 1.23 in j2oj|, under Assumption [5J the pair 


Ai 

G 2 Ci 


0 


ni X qPm. 

Gi 



' Bi ' 

1 

G2D1. 


(7) 


( 8 ) 
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is controllable for i = 1,..., N. Hence, there exist constant matrices Kn and with proper dimensions 
such that the matrix 


Am 4 


Ai + BiKu Bil\2i 

G 2 (Ci + DiKu) G\ + G 2 D il\2i 


(9) 


is Hurwitz. 

The regulator equations play a key role in the output regulation problem (Ql), and the following 
lemma establishes its solvability for the coordination design. Its proof is similar with that of Lemma 1.27 
in [20| and thus omitted. 


Lemma 3 There exists a neighborhood Wi of Wi = 0, such that for any Wi £ Wi, the following equations: 

Xi(w)S = Ai(w)Xi(w ) + Bi(w)Ui(w), (10) 

Zi(w)S = G\Zi{w ) (11) 

have a solution (Xi(w), Zi(w)) with Ui(w) = KuXi(w) + K2iZi(w). Moreover, Xi(w ) and Zi(w) satisfy 

Ci(w)Xi(w) + Di(w)Ui(w ) + F = 0. 


It is time to give our first main result. 

Theorem 1 Under Assumptions [7] and [H the robust consensus tracking problem of this multi-agent 
system can be solved by the control law © with selected matrices Ku, K 2 i, i = 1,..., N, and Lq. 

Proof: Under Assumption [7] and by LemmaEJ for any i, there exists a neighborhood IT,: of Wi = 0, such 
that for any Wi £ Wi, there exist two matrices Xi(w) and Zi{w) satisfying 

Xi(w)S = Ai(w)Xi(w ) + Bi(w)Ui{w) 

Zi(w)S = GiZi(w) 

where Ut(w) = KuXi(w) + K 2 iZi(w) . Taking W as the direct product of all Wi (i.e., W = W\ x • • • x W)v) 
and performing a transformation Xi = Xi — Xi(w)v, = £* — Zi{w)v gives 

Xi = (Ai(w) + Bi(w)K\i)xi + B i (w)K 2 if l 

fi = G2(Ci(w) + Di{w)Kii)Xi + (Gi + G2Di(w)K2i)fi — G2iji 

= ( Ci(w) + Di(w)K u )xi + Di(w)K 2 ifi 

Denote x C i = col(5,,, G) and rewrite these equations in a compact form: 

X c i — A ci (w)x ci T E c i(w^TJi 

Ci — C c i(w')X c i 


where E C i(w ) = col(O raiXnz , G2F), C c i{w) = [Ci{w) + Di(w)Ku, Di(w)K2i] are constant matrices with 
uncertain parameters. By the exponential stability of A C i{w) and Lemma [2j we apply Lemmas 4.6 and 
4.7 in 21] and obtain the convergence of x C i. As a result, the proof is completed. I 


Remark 5 It can be found that if yo = v (i.e., F = —I q ), it means that the state variable v of the leader 
can be directly obtained when it is reachable from some other agent. This special case has been partly 
considered in \ll . 15]. We extend the control law in If, H/ by only using the measurement output of the 
leader. Similar control laws were proposed in EQy when the followers are all integrators, while here we 
consider more general cases in this formulation. 
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In some circumstances, the follower may not have access to its own state and only its output mea¬ 
surement is available. The following theorem shows how the robust consensus tracking problem can be 
solved by an output feedback control law. 


Theorem 2 Under Assumptions Q] and[ H there exist proper matrices Ku, K 2 i, K 3 i, and Lq, such that 
the robust consensus tracking problem of this multi-agent system is solved by the following control law: 


Ui — A uCi T A 2 i^i 

Ci — AiQi -f- B lUl T- K 3i (yi Ci^fi Dim) 

ii = Gi^i + G 2 {y x + Fiji) 

Vi = Srji- L 0 Fv v i 


( 12 ) 


Proof: The proof is similar with that of Theorem |T| Since the pair Q is controllable, we still take 
Ku and K 2 i as Theorem[L] Note that ( Ci , Af) is observable, there exists an K 3i such that Ai — K 3 iCi is 
Hurwitz. Denote x C i = col(:Ei, f j) and consider the closed-loop system of agent i in a compact form as 


where E ci {w) = col(0 


riiXmi ^rii X m 3 


X c i — A c i (w')X ci T E c i(w)Vi 
G 2 F ), and 



Ai(w) 

Bi(w)Ku 


Bi{w)K 2i 

A ci {w) = 

K 3i Ci(w) 

^1 i 


^2 i 


G 2 Ci(w) 


G 

1 + G 2 Di(w)K 2 i 

with Hu = Ai- I\ 3i Ci(w) + BJxu + K 3i (Di( 
The nominal system matrix A C i( 0) is 

w) - D)Ku 

and 

= BiK 2i + A 


At 

BiKu 


BiK 2i 

A cl { 0) = 

K 3i Ci Ai- 

- K 3i Ci + BiK u 

BiK 2i 

Let 

G 2 Ci 

G 2 DiK u 

' i nt o 

0 

G\ + G 2 DiK 2 i 


Ti = 

4 ° 

o 

° ^ 



Then, 

ici(O) = 

Ai + BiKu BiKu BiK 2 i 

0 Ai- I< 3i Ci 0 

G 2 (Ci + DiK\i) G 2 DiKu G\ + G 2 D,K 2 i 

Recalling the selection of Ku,K 2 i , K 3 i , A c i(0) and hence A C i is Hurwitz. There exists a neighborhood 
W of w = 0, such that A C i(w) is also Hurwitz. Following the same procedure as Lemma [3J there exist 
unique matrices Xi(w), Yi(w ), and Zi(w) satisfying 


Xi(w)S = Ai(w)Xi(w) + Bi{w)Ui(w) 

Y l (w)S = Ai(w)Xi(w ) + Bi(w)Ui(w) + K 3i Ci(w)(Xi(w ) - Y t (w)) 
Zi(w)S = G\Zi(w) + G 2 [Ci(w)Xi{w) + Di(w)Ui(w ) + A] 
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where Ui(w) = KuYj(w) + K- 2 iZi(w). From the uniqueness, Xi[w) = Yi(w). By the similar techniques 


201 ]. we can also obtain Ci(w)Xi(w) + Di(w)Ui(w) + F = 0. 


of Lemma 1.27 in 

Performing a transformation Xi = Xi — Xi(w)v , (i = (i — Yi(w)v, — Zi(w)v and denoting 

x ci = col(xi, Ci, li) gives 

•Tcz — A c i(w^X c i “f B c i(^W^TJi 

where C c i{w ) = [Cjfw), Di(w)Ku , H,;(w)A' 2 ?;] are constant matrices with uncertainties. By the stability 
of A c i(w) and Lemma [21 we apply Lemmas 4.6 and 4.7 in 21] and obtain the convergence of x c i. As a 
result, the proof is completed. I 

Remark 6 This problem has been partially investigated in 07 under switching topologies. However, the 
constructed controllers heavily relied on the exact known system matrices and hence can’t admit uncer¬ 
tainties. The internal model-based control law here facilitates us to allow small parameter uncertainties 
and thus obtain a robust control law. Moreover, without restricting the eigenvalues of S are in the closed 
left half-plane, the common Lyapunov function technique helps us handle the switching topologies even 
the references may be unbounded. 

Remark 7 Another relevant paper is 07, in which a robust output regulation problem of linear multi¬ 
agent systems was studied by a so-called canonical internal model. The main differences between our work 
and that of 07 are at least two-fold. First, the method proposed in 07 only applies to the case when the 
outputs have the same dimension with its inputs. Second, only an output feedback control law was derived 
in il a l. while here both state feedback and output feedback control laws are proposed. Moreover, since the 
out feedback control law in \l A l needs to estimate the state of the internal model, its dimension may be 
much higher than the control da when q > 1. 


4 Simulations 

For illustrations, we present an example and consider three followers with following system matrices 

Ai = 1 + ei, B\ = 1 + ei, Ci = 1 + ei, D\ = 1 + ei, 


Ai — 


0 1 + £2 
-l + e 2 0 


, B2 — col( 0 , 1 + 62), C2 — [1 + £2, 0], D2 — £2, 


As = 


£3 1 0 

-l + Ea 0 1 

2 £3 1 


The leader is described by 


B 3 = col(0,1,1 + ei ), C 3 = [0, 1, 0], D 3 = 1. 


Vi = v 2 , V2 = -Vi, y 0 = -Vi. 


We assume the interconnection topology is switching between graph Qi (* = 1, 2) described by Figure [Q 
The switchings are periodically carried out as {Q 1 , Q 2 , Qi, Q 2 , • • • } with periods t = 5. 

The uncertain parameters £i,£ 2,£3 are taken between [—1,1], The robust consensus tracking perfor¬ 
mances under state and output feedback control laws were depicted in Figures [2] and [3] 










(a) The graph Q\ (b) The graph Q 2 

Figure 1: The communication graphs. 




m m 

(a) The trajectories of the leader and followers. (b) The tracking errors of three followers. 

Figure 2: The tracking performance of three agents under the controller 0. 




(a) The trajectories of the leader and followers. 


(b) The tracking errors of three followers. 


Figure 3: The tracking performance under the controller m- 
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5 Conclusions 


A robust consensus tracking problem of heterogeneous multi-agent systems was solved to admit small 
uncertain parameters in the agents’ systems. In conjunction with the internal model techniques, a 
common Lyapunov function was used to overcome the challenges of switching topologies. Future work 
includes extensions to more general graphs and multiple leaders. 
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